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Simple symmetry considerations would suggest that the transition from the smectic-A phase to the 
long-range bond orientationally ordered hexatic smectic-B phase should belong to the XY universal- 
ity class. However, a number of experimental studies have constantly reported over the past twenty 
years "novel" critical behavior with non-XY critical exponents for this transition. Bruinsma and 
Aeppli argued in Physical Review Letters 48, 1625 (1982), using a 4 — e renormalization-group cal- 
culation, that short-range molecular herringbone correlations coupled to the hexatic ordering drive 
this transition first order via thermal fluctuations, and that the critical behavior observed in real 
systems is controlled by a 'nearby' tricritical point. We have revisited the model of Bruinsma and 
Aeppli and present here the results of our study. We have found two nontrivial strongly-coupled 
herringbone-hexatic fixed points apparently missed by those authors. Yet, those two new nontrivial 
fixed-points are unstable, and we obtain the same final conclusion as the one reached by Bruinsma 
and Aeppli, namely that of a fluctuation-driven first order transition. We also discuss the effect of 
local two-fold distortion of the bond order as a possible missing order parameter in the Hamiltonian. 



I. INTRODUCTION 

The nature of phase transitions in two dimensional 
(2D) systems, has been the subject of numerous inves- 
tigations over the last three decades. According to the 
Mermin-Wagner-Hohenberg theorem [Q, the continuous 
symmetry of the XY and Heisenberg models cannot be 
spontaneously broken at finite temperature, and there 
can be no long range magnetic order. However, Koster- 
litz and Thouless (KT) Q argued that there is a new 
type of phase transition from a high temperature phase 
with exponentially decay of the correlations to a low tem- 
perature phase with power law decay of the correlations. 
The idea of KT has been extended by Halperin and Nel- 
son || and Young Q to the 2D melting problem. One 
of the main results of the KTHNY theory is the predic- 
tion of an intermediate 2D phase called the hexatic phase 
for systems that have a six-fold (hexagonal) symmetry in 
their crystalline ground state. This hexatic phase dis- 
plays short range positional order, but quasi long range 
bond-orientational order, which is different from the true 
long range bond-orientational and quasi long range trans- 
lational order of a 2D solid phase |3||| . The hexatic phase 
can be characterized by a bond-orientational order pa- 
rameter defined by * (i = * 6 | cxp(?6^e)- Assuming that 
the hexatic state occurs and is not preempted by a direct 
first order transition from the solid to the isotropic liquid 
phase, the system should, in the simplest scenario for 2D, 
display either a KT transition or a first order transition 
from the hexatic state to the isotropic liquid phase ||. 

It was soon realized after the proposal of the KTHNY 
theory that the hexatic phases, with short range posi- 
tional order but true long range bond orientational order, 
might exist in highly anisotropic three dimensional (3D) 
systems. Specifically, Birgeneau and Lister || applied 



the notion of a hexatic state of the 2D melting theory to 
3D liquid crystal phases consisting of stacked 2D layers. 
They proposed that some of the experimentally observed 
smectic liquid crystal phases could be physical realiza- 
tion of 3D hexatics. Birgeneau and Lister suggested that 
the (weak) interlayer interaction could promote the quasi 
long range order of 2D hexatic layers to true long range 
bond orientational order in 3D. 

Stimulated by these theoretical advances, numerous 
experimental efforts have been undertaken to test the- 
oretical predictions in different liquid crystal materials 
candidate for displaying hexatic phases 0. An x-ray 
study of the liquid crystal compound 650BC (n-alkyl-4'- 
m-alkoxybiphenyl-4-carboxylate,n=6,m=5) S provided 
the first indication of the existence of the 3D analog of 
the 2D hexatic phase. It was also found that in addition 
to the hexagonal pattern of diffuse spots of scattered in- 
tensity, which is the signature of the hexatic phase, there 
are some broader peaks corresponding to correlations in 
the molecular orientations about their long axes ^ . The 
positions of these peaks show that, locally, the molecules 
are packed according to a herringbone pattern perpen- 
dicular to the smectic layer stacking direction (see Fig. 
1). Despite the indication of short range herringbone 
correlations, this novel phase is simply denoted as the 
hexatic-B (HexB) phase. Upon increasing temperature, 
this phase looses its long range bond orientational or- 
der and undergoes a transition to the smectic-A (SmA) 
phase, which essentially consists of a stack of 2D liquid 
layers. Upon cooling, the HexB phase transforms via 
a first order phase transition into the crystal-E (CryE) 
phase, which exhibits both long range translational or- 
der and long range herringbone orientational order in the 
orientations of the molecular axes. 
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a) 




b) 



FIG. 1. Local hexagonal coordination of the molecules 'as 
seen' along the stacking direction of the smectic layers. The 
elliptical shape of the molecules as seen along the stacking di- 
rection is meant to represent the "wide" benzene rings present 
on most thermotropic liquid crystal molecules, a) without 
herringbone correlations, b) with local herringbone packing 
correlations of the molecular axes. 



According to the U(l) symmetry of the $6 bond ori- 
entational order parameter, one would naively expect to 
find XY-like critical exponents at the SmA— HexB tran- 
sition. However, heat capacity investigations near the 
SmA— HexB transition of 650BC and subsequent 

calorimetric studies on many other components in the 
nmOBC homologous series 0Jl^l have constantly been 
reporting continuous (second order) SmA— HexB transi- 
tions with very large values for the heat capacity critical 
exponent, a ~ 0.6. This is drastically different from 
the 3D XY critical exponent a = -0.007 0. As well, 
thermal conductivity and birefringence experiments have 
allowed the determination of other static critical expo- 
nents, all of which differ systematically from the 3D XY 
value, while they, together, obey the standard scaling 
relationships expected for a genuine second order phase 
transition M. 

In the light of the existence of the short range her- 
ringbone fluctuations, detected in the x-ray diffraction 
studies 0, Bruinsma and Aeppli (BA) [Q formulated 
a Ginzburg-Landau theory that includes both the hex- 
atic and herringbone order. Because the HexB phase 
exhibits only short range positional order, BA suggested 
that the herringbone order can also be represented by an 
XY order parameter described by $2 =| $2 | exp(i2</>2). 
At the microscopic level, it is the molecular anisotropy 
that creates a coupling between the hexatic bond or- 
der and the herringbone molecular order jL3|,|l4j. At the 
phenomenological Ginzburg-Landau level, this coupling 
is described by a hexatic-herringbone interaction term 
VW-hcr - ftRe(*5$l). 

BA constructed an appropriate free energy density 
based on symmetry considerations and investigated the 
effects of fluctuation corrections to the mean field be- 



havior for 3D systems. In the mean field approach, their 
results indicate that the SmA— HexB transition should be 
continuous. However, 4 — e renormalization group (RG) 
calculations, which includes thermal fluctuations and the 
coupling term foRe^g^), show that short-range molec- 
ular herringbone correlations coupled to the hexatic or- 
dering drive this transition first order, which becomes 
second order at a tricritical point fl2]| . 

Interestingly, heat capacity measurement studies of 
(truly two-dimensional) two-layer free standing films of 
different nmOBC compounds yield very sharp heat ca- 
pacity peaks near the SmA— HexB transition which can 
be described by the critical exponent a w 0.3 |7|JI^].This 
is in sharp contrast with the usual broad and nonsingular 
specific heat hump associated to the KT transition in the 
2D XY model, or yet the first order transition that could 
occur in a physical system where the vortex core energy 
is less than some critical value P,|l6||. This a w 0.3 re- 
sult further suggests that the SmA— HexB cannot be de- 
scribed by a simple model with a unique (critical) XY-like 
order parameter. In this context, there has been some 
numerical simulations done to obtain more insight into 
the nature of the SmA— HexB transition in 2D systems. 
The model used in the simulations [17],|l8| consists of a 
2D lattice of coupled XY spins based on the BA Hamil- 
tonian. The simulation results suggest the existence of 
a new type phase transition in which the two different 
orderings are simultaneously established through a con- 
tinuous transition. It is interesting to note here that, in 
seemingly different context, there has also been numer- 
ous theoretical and numerical attempts to identify 'novel 
chiral' universality classes for systems such as frustrated 
XY model and Ising-XY coupled model [ ft9[ . 

Certainly, for three dimensions, the scenario of a 
fluctuation-driven first order SmA— HexB transition due 
to hexatic-herringbone coupling would appear reason- 
able for the SmA— HexB transition in 650BC which, 
upon further cooling, undergoes a HexB— CryE transi- 
tion that establishes long range herringbone and posi- 
tional order. However, the mixture of 3(10)OBC and 
PHOAB exhibits a very large temperature range for the 
HexB phase above the crystallization temperature to the 
CryE phase. If there were herringbone fluctuations near 
the SmA— HexB transition in that mixture, one could ex- 
pect them to be quite small because of the large HexB 
temperature range, and the SmA— HexB transition could 
then possibly be continuous, and to belong to the (then 
naively expected) XY universality class. However, the 
fact that the SmA-HexB transition in the 3(10)OBC- 
PHOAB mixture is found to be first order does not sup- 
port this simple minded argument |?]]. Following the 
same type of reasoning, recent x-ray diffraction studies 
on 750BC (l]] show that the intensity of the herringbone 
peaks is weaker than those of 650BC. In principle, if one 
assumes that 650BC is near a tricritical point, 750BC 
should therefore be further removed from this point (due 
to the weaker herringbone diffraction peaks, and conse- 
quently, weaker Vh ex — her)) with again the possibility to 
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recover 3D XY critical behavior. Yet, the same (uncon- 
ventional) heat-capacity critical exponents are found for 
these two materials. 

The experimental results above could be interpreted as 
a possible indication of an underlying "novel" (non-XY) 
stable fixed point that control the SmA— HexB transition 
when herringbone correlations are present. The apparent 
lack of progress on the theoretical side of the SmA— HexB 
problem has led us to reinvestigate the model of BA 
and to, specifically, look for a possible calculation error. 
Firstly, it is important to note that the conclusion of a 
fluctuation-driven first order within a 4 — e calculation is 
acutely depending on the 'numerics' and not constrained 
by symmetry consideration: a small error (such as a fac- 
tor 2 instead of 4 here or there) can change the conclu- 
sion of a fluctuation-driven first order transition. Sec- 
ondly, and more specific to the BA problem, we show in 
the next section, when describing the Ginzburg-Landau 
free energy density for the SmA— HexB transition, that 
some terms in the RG equations, to first order in e, were 
missed in the work of BA. Based on our RG equations, we 
find two nontrivial strongly-coupled herringbone-hexatic 
fixed points, apparently missed by those authors. How- 
ever, those two nontrivial fixed-points are unstable, and 
we reach the same final conclusion as the one found by 
BA, namely that of a fluctuation-driven first order tran- 
sition. We also discuss the possibility of a third and a pri- 
ori possibly physically pertinent order parameter in the 
Hamiltonian model of the SmA— HexB transition. Be- 
cause of local distortion of the bond orientational order 
induced by the anisotropy of the intermolecular potential 
|p3| , pr| and the herringbone correlations, one may gener- 
alize the Hamiltonian to the case with three XY-like order 
parameters, in which two of them are two-fold symmetric, 
one for the herringbone correlations, <E>2> and one for the 
local two- fold distortion, <3>2, and a third order parameter 
with six- fold symmetry, VJ/g; related to hexatic ordering. 
We discuss both mean field and RG calculations for this 
new model. 

The rest of this paper is organized as follows. In 
Sec. II. A, we reintroduce the BA model and present the 
result of our RG calculations. In the Sec. II. B, we gener- 
alize the Hamiltonian to the case of three order parameter 
and discuss the mean field theory and RG results. The 
discussions and conclusions appear in Sec. III. 



II. MODELS AND RG CALCULATIONS 

A. BA Hamiltonian 

To formulate the Landau Ginzburg (LG) free energy, 
which describes both the hexatic and herringbone order, 
one recalls that the hexatic order is six-fold symmetric, 
while rotating a herringbone pattern by 180° leaves it un- 
changed. Consequently, the appropriate LG free energy 
ought to be invariant with respect to the transformation 



4>2(r) — > (j>2(r)+nn and ipe{ r ) — ¥ ipe(r) + m(2Tr/6) where 
n and m are integers. Thus to lowest order in *g and 
$2, the BA Hamiltonian O is: 



(3F = 



|V$ 2 



1 



r-2 



-t: v* 6 r +-=- 1* 



+ w |$ 2 | 2 |* 6 | 2 +hRe{t>* e <S> 



(2.1) 



The condition for thermodynamic stability of F for w = 

is /i 4 / 3 < (4 4 / 3 /3)m 2 M6 ■ This condition can be obtained 
by minimizing the free energy density on the critical 
isothermal line r 2 = r 6 = and requesting that (3F > 0. 
As discussed in the Ref . |l2] , in the mean field approxima- 
tion, for w = and h = the phase diagram in the r 2 — r§ 
plane includes four distinct phases: an isotropic (SmA) 
phase with ^e = <f>2 = 0, a hexatic (HexB) phase with 
no herringbone order with ^e ^ 0, $2 = 0, a "putative" 
'herringbone liquid crystal' phase with ^e = 0, $2 7^ 0, 
and a fully ordered state with $2 7^ 0, $6 ^ akin to 
a crystalline E phase j^0|, with all these phases sepa- 
rated by second order transitions. However, if h 5^ 0, 
the herringbone liquid crystal state with no hexatic or- 
der ($2 7^ 0, \&6 = 0) is eliminated because $2 acts as a 
symmetry breaking field on ytg. Within mean field the- 
ory, the transition lines between the isotropic and ordered 
phases remain second order for h ^ 0, and terminate to- 
gether with the first order line at a multicritical point 

13 ■ 

We now discuss the RG flow equations and the stability 
of the fixed points (FPs). Our calculations show that the 
RG equations to first order in e = 4 — d are: 

dr 2 ^ 16A'4it 2 AK^w 
~dT ~ r2+ l + r 2 + l + r 6 
c?rg I6K4UQ AK4W 

~df = 2r6 + TT77 + 1 + ^2 

— = eu 2 - 40K 4 uj - 2K A w 2 - 9K A h 2 
dl 

due, o o 

— ^ = eu e - 40K 4 u 2 6 - 2K 4 w 2 

dw o 2 

— — = ew — I6A4WU2 — I6A4WU6 — 8K4W — I8K4I1 
dl 



— = eh- 24A 4 /m 2 - 12K 4 hw, 
dl 



(2.2) 



where K4 = l/8ir 2 . The above RG equations differ from 
those found by BA in Ref. pf: 

• The first set of differences are the 4Kiw/(l + re) 
and 4K 4 w/(l + r 2 ) terms in the first and sec- 
ond equations, while BA have 2K 4 w/(l + re) and 
2K\wj (1 + re). The extra factor 2 comes from the 
fact that the fields *&e and $2 are complex and 
the related correlations have two components. For 
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h = 0, Eq. (2.2) (with the factor iKiiv) reproduces 
the RG equations of coupled two components two- 
vector model as in previous studies ^2j,|3). We 
therefore believe that the above RG equations for 
dr 2 jdl and dr§/dl are correct. 

• Compared to the BA equations, we also obtain two 
completely new terms, — lSK^h 2 , in the fifth equa- 
tion and — YlKtJiw in the sixth equation, which can 
be easily checked using Feynmann diagram tech- 
nique. Indeed, these two new terms come from 
the connected diagrams in the second order per- 
turbativc RG obtained by multiplication of the rel- 
evant diagrams of h^%^\ with M/gS??; 3 , an( l 01 
w | * 2 | 2 | *6 I 2 with /iRe(^g$2); respectively. 

Because of the two extra terms in the RG equations for 
dw/dl and dh/dl, we obtain, in addition to the simple 
decoupled FP (rg = r\ = -e/5,ug = u* 2 = e/(40if 4 ), 
w* = h* = 0), two new fixed points such that (w* ^ 
0, h* = 0) and (w* ^ 0, h* ^ 0). The first nontrivial FP 



is given by h* = 0, rg 



-e/4,«5 = «5 = e/(48*r 4 ), 



and w* = 6/(24^4). This FP, akin to the one found 
in minimally coupled two component two vector model 
p2|p3[ , was not discussed by BA. 

However, and most interestingly, we find another 
"new" nontrivial mixed herringbone-hexatic FP with all 
the couplings being non-zero: 

r* & = -0. 24845566c, 
r* 2 = -0. 24018995c, 
u% = 0.01941403e/K4, 
u* 2 = 0.01838082e/K4, 
w* = 0.04657169e/K4, 
h* = ±0.00766519e/iT4. 

(2.3) 

Therefore, based on our RG calculations, there is a FP 
with h* ^ 0, which was not found in the previous work 
of BA. Linearizing the recursion relations in the vicinity 
of the FPs yields for the FP with (w* ^ 0, h* = 0): 
2/1 = 2-e/2,y 2 = 2 - e/6, y 3 = -e,y 4 = -2e/3,y 5 = 
ye = 0. Thus, two eigenvalues are marginal, compatible 
with what has been found in similar minimally coupled 
two component two vector model p2|| . The eigenvalues 
for the FP with (h* ^ 0, w* ^ 0) above are 

2/1 = 2- 0.488829e, 
y 2 = 2 - 0. 115889c, 
y 3 = -0.997894e, 
y 4 = -0.537266e, 
iy 5 = +0.121467e, 
y 6 = +0.0402392e. 



These results show that there are four positive eigen- 
values, and the above "new" nontrivial FP is there- 
fore unstable. The two largest (most positive) eigen- 
values, ?/i and j/2, correspond, respectively, to the 



thermal eigenvalue and the 'relative' coupling strength 
that positions the system in coupling parameter space 
and determines what sequence of phase transition oc- 
curs. Namely, isotropic— > (hexatic+herringbone) via 
a unique phase transtion or isotropic — > hexatic 
— >(hexatic+ herringbone) via two distinct phase transi- 
tions. The four eigenvalues 2/3—2/6 essentially control the 
flow in the w — h plane. 2/5 an d 2/6 are positive, and 
we interpret the result as an indication that the above 
"new" nontrivial mixed herringbone-hexatic FP is unsta- 
ble. Indeed, we have confirmed this by explicit numerical 
integration of the RG equations, and found that the RG 
flow goes to the unstable region identified above, which 
we interpret as the transition being driven first order 
by fluctuations. Therefore, while we have indeed found 
some discrepancies between our RG equations and those 
of BA, and recovered two extra coupled fixed points, 
we at the end still reach the same physical conclusion 
of BA, namely that of a fluctuation-driven first order 
smA— HcxB transition. 



B. Generalized Hamiltonian 

We expect physically that the local molecular 
anisotropy (e.g. from the anisotropic nature of benzene 
rings found in most thermotropic liquid crystal materi- 
als) to couple to the local bond direction, and to create 
a local two-fold distortion of the otherwise perfect local 
six-fold symmetric nearest- neighbor bond order |]l3| , |l4| . 
Consequently, we now discuss the LG free energy, which 
describes both the hexatic and herringbone order, as well 
as the local two-fold distortion of the bond order. If we 
assume that the distortion of lattice has two-fold symme- 
try, with the order parameter ^2 —\^2 | exp(i2^2)> then 
the resulting free energy is invariant under the transfor- 
mation </> 2 (r) — > 02 (r) + mr, tpe(r) — * tpe(r) + m(2n/6), 
and tp2(f) ~ > fair) + W where n, to, and p are integers. 

From an RG point of view, our motivation to expand 
the symmetry of our Hamiltonian stems from the obser- 
vation that in N coupled 2-vector models a new stable 
fixed points (called mixed fixed point [ p2"|]23] | ) appears in 
the coupling parameter space (when N > 2). Thus, to 
lowest order in \&6 , $2, and ^2, we have (3F — /3Fq + U, 
where the Gaussian part is given by 



d 6 x 



r 6 |*e 



-r a |*2 I 2 +r 2 1*2 1 2 



2rRe($ 2 *;)+ |V* 6 | 



|V$ 2 | 2 



|W 2 | 2 +2sRe(V*aV*|5) 



(2.5) 



(2.4) 

and the pcrturbative Hamiltonian has the following form 



U = d 



U6 |*€ 



-U2 I $ 2 



-U2 |*2 
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+ W 1 \^ 6 H $2 | 2 +W2 | *6 Pi *2 | 2 +W 3 | $ 2 H *2 | 2 

+ viRe(** 6 $2*l) + w 2 Re(*6*2*2) + v 3 I * 6 | 2 Re($ 2 * 2 



du' 2 



+ v 4 | $2 | 2 Re($ 2 *2 



1*2 | 2 Re($2* 2 



(2.6) 



For the case that ri = r%, one can simply diagonalize 
the Gaussian part of the Hamiltonian using the transfor- 
mation $ 2 = ($2 + *2)/\/2 and \& 2 = ($2 - *2)/v / 2, 
and then do the RG calculations. The RG calculations 
for the case that il/g = were done by Yosefin and Do- 



many 25 in the study of the phase transitions in fully 
frustrated XY models 

In the mean field approach, there are now four distinct 
phases for r ^ (* 6 = $ 2 = * 2 = 0; * 6 = 0, $ 2 ^ 

0,* 2 + 0;*6 f 0,* 2 = $2 = 0;* 6 f 0,* 2 + 0,$ 2 + 

0). One should note that for the phases where both $2 
and *2 are non-zero, we have the condition of local sta- 
bility of the free energy, r%f% < r 2 . In addition, the sin- 
gularity of the propagators at zero wavevector (q) = 0) 
is for T2T2 = r 2 , which is the critical point of the system. 

To obtain further insight into the specific situation 
where both $2 and 'J 2 go simultaneously critical (soft), 
we perform an RG calculation. To simplify the calcu- 
lations, we consider the case that T2 = ^2, so that the 
fields $2 and ^2 are simultaneously critical (soft), and 
that they are equally coupled to the hexatic field 
(u2 = U2, u>i — W2). We further need to require that 
the full theory, after diagonalization of the gaussian part, 
is self-consistent with no new RG-generated terms. This 
imposes that h\ — /i 2 and v\ = V2- Using the above 
mentioned transformation for <I> 2 and ^2 and rescaling 
the fields, one can rewrite the Hamiltonian as, 



(3F 



d A x 



"2 l V$ el' 
V 2 |$ 2 | 4 

-Wn I *fi 



i|v4,| 2 



r«2 I *2 I twj 
* 2 | 2 +w' 3 I $ 2 



i 1*2 | 2 

\ |V* a | 
|* 2 | 



7^l*2| 2 



-u 6 I * e 



-h'.Re^l) + h' 3 Re(^ 2 2 % 2 ) + ^Re(**$ 2 ^) 



(2.7) 



where the new (primed) coefficients can be written in 
terms of old coefficients. To first order of e, the RG 
equations are given by, 



2r 6 



dr 6 
dl 

dr'n , 

-i^'2 

dr'o 



dl 

due 

~dT 



eu 6 



16K 4 UQ 

+ - — — ^ 




AK 4 w' 2 


1 + r 6 


l + r'2 


l + r'2 


\6K 4 u' 2 


4K 4 w[ 


AK 4 w' 3 




l + r 6 


l + r'2 


+ — M ^ 


AK 4 w' 2 


AK 4 w' 3 


l + r' 2 


- ~% — — ^ 

1 + r 6 


l + r' 2 


- A0K 4 u 2 6 - 


2K 4 wf - 


2K 4 w' 2 2 



du' 2 

~dT 
~dT 



dw 
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—± = eu' 2 - 40K 4 u' 2 z ~ 2K 4 w'{ - 2K 4 w' 3 z - 9K 4 h'{ 



2K 4 h' 3 2 

eu 2 - 40K 4 u 2 2 - 2K 4 w 2 - 2K 4 w' 2 - 2K 4 h' 3 2 
K 4 v' 2 

ew[ — 16K 4 Uf)W[ — 16K 4 u' 2 w' 1 — 8K 4 w' 2 
AK 4 w' 2 w' 3 - 18K 4 hf - 2K 4 v[ 2 



—— = ew' 2 — 16K 4 uqw' 2 — 16K 4 u' 2 w' 2 — 8K 4 i 



dl 



dw' 3 

~dT 

dh[ 

~df 

dh' 3 

~dT 



dv[ 
~~dT 



4 



4:K 4 w[w 3 - AK 4 vf 

ew' 3 — 16K 4 u' 2 w' 3 — 16K 4 u' 2 w' 3 — 8K 4 w' 3 
AK 4 w' lW ' 2 ~ 16K 4 {h' 3 ) 2 - AK 4 vf 
eh'i — 24K 4 b! x u 2 — \2K 4 w\h! x — AK 4 Vih' 3 

eh' 3 - 8K 4 u' 2 ti 3 - 8K 4 u' 2 ti 3 - l6K 4 w' 3 ti 3 

ev[ - 8K 4 v[u 2 - AK 4 w' x v' x - 8K 4 w' 2 v[ 
8K 4 w' 3 v[ - \2K 4 h! x b! 3 . (2. 



We have found a number of FPs for the above RG equa- 



tions that fulfill the condition (r 



and for which 



'2- 



v 2- 



hi 



'2- 



= v% and 



0- 



Some of these are given in the Table I, where each col- 
umn correspond to a different FP (the nontrivial mixed 
herringbone-hexatic FP found in Section Ha occurs here 
as well, but is again unstable). As in the simplest case 
of Hamiltonian (2.1), none of the FP correspond to a 
nontrivial stable fixed point: each fixed point (column) 
shows more than two positive eigenvalues. Given the 
complexity of those nonlinear equations we cannot be 
100% sure that we have found all the (unstable) FP in 
the (uq , u' 6 , u' 2 , w'i , w' 3 , h[ , h 3 , v'^) plane. However, a nu- 
merical investigation of the RG flow in that plane start- 
ing from a large number of initial values for the coupling 
parameters always failed to converge towards a stable 
(attractive) fixed point. Therefore, we reach the same 
conclusion obtained in the previous section, namely that 
of a fluctuation-driven first order transition for this ex- 
panded symmetry Hamiltonian, and the stabilization of 
novel fixed point in N coupled two vector models for 
N > 2 does not appear to occur in this generalized Hamil- 
tonian due to the extra coupling parameters. 
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Table I: The FPs of RG equations for 
generalized Hamiltonian. 



r'ih 


-1/5 


-3/11 -2/7 





-0.2761944898 


-0.2583527792 


-0.2727272730 


r?/e 


-1/5 


-3/11 -2/7 


-1/5 


-0.2761944898 


-0.2756996328 


-0.2727272730 




-1/5 


-3/11 -2/7 


-1/5 


-0.2566490108 


-0.2756996328 


-0.2727272724 




1/40 


1/44 1/56 





0.0202792491 


0.0237809941 


0.0227272727 


u' 2 *(K 4 /e) 


1/40 


1/44 1/56 


0.0125 


0.0202792491 


0.0194412033 


0.0170454546 


u' 2 *(K 4 /e) 


1/40 


1/44 1/56 


0.0125 


0.0238702512 


0.0194412033 


0.0170454546 


w'*(K 4 /e) 





1/44 1/28 





0.0405584982 


0.0170262066 


0.0227272727 


w' 2 *(K 4 /e) 





1/44 1/28 





0.0164217503 


0.0170262066 


0.0227272727 


w>£(K 4 /e) 





1/44 1/28 


0.05 


0.0164217503 


0.0430587966 


0.0454545454 


h'*(K 4 /e) 





1/44 














h'*{K 4 /e) 





1/44 


± 0.025 





± 0.0041763898 ± 0.0113636364 


v[*(K 4 /e) 





1/44 















III. DISCUSSION 



In Section II. A, we found that there are two "new" 
FPs missed in Ref. fT^] . However, those FPs are unsta- 
ble, and we reach the same final conclusion as Bruinsma 
and Aeppli, namely that the SmA— HcxB transition is 
driven first order by fluctuations in the BA Hamiltonian. 
We also discussed a slightly modified simple model that 
considers not only the hexatic and herringbone order, 
but also one that involves the local two-fold deforma- 
tion of the bond correlations induced by the herringbone 
correlations. We assumed that this deformation can be 
represented by a two- fold symmetry order parameter, as 
in the case of herringbone order, and wrote the free en- 
ergy based on symmetry arguments. We were not able 
to find a new stable FP which could possibly result in 
unconventional ("new") second order critical exponents. 

It is not clear to us in what directions to pursue the 
paradoxical puzzle of "new universality" (non 31? XY 
transition) in hexatic liquid crystal materials. In the 
work presented here, we have found a novel "mixed" 
hexatic-herringbone fixed point in the theory, but which 
is unstable to first order in e. One note that the two 
positives eigenvalues j/5 and ye in Eq. 2.4 are only very 
slightly positive for e = 1. This observation may open 
the possibility that in a calculation that includes hexatic- 
herringbone coupling, there is no stable fixed point to 
lowest order in e, but that the fixed point may be stabi- 
lized in a theory that goes beyond an 0(e 1 ) calculation. 
This is what happens, for example, in the normal to su- 
perconducting phase transition where the e expansion to 
order e 1 predicts a fluctuation-driven first order phase 
transition p6|] while theoretical arguments and Monte 
Carlo simulations strongly argue for a second order (in- 
verted 3D XY) phase transition |27|. 



Having said that, one should note that there are ex- 
periments on liquid crystal materials that do not dis- 
play any herringbone correlations [ p8|j29]| but still show 
a SmA— HexB transition with exponents that differ from 
the critical behavior expected to a 2D [E8| or 3D [^9| XY 
critical behavior. That may suggest that the whole idea 
of hexatic— herringbone interactions is a red herring. An- 
other possibility is that of (more subtle) 'hidden' order 
parameter(s) distinct from the herringbone order charac- 
terizes the SmA— HexB transition in real materials, and 
that the coupling between this hidden order parameter 
and the hexatic order parameter produces a novel 
stable fixed point. Clearly, more experimental studies 
are needed to shed light on this problem. In particular, 
high resolution scattering experiments would seem nec- 
essary to search for extended short-range correlation in 
either molecular correlations or distortion of hexagonal 
co-ordination to shed some light on what such 'hidden' 
order parameter(s) may be. 

We finally note that a related (unconventional criti- 
cal behavior) situation arises in the context of layered 
systems of smectic liquid crystals studied by Defontaines 
and Prost j30| . These authors have argued that criti- 
cal points that do not involve any symmetry change can 
define a set of new universality classes in layered sys- 
tems. Possibly, considerations of some features of the 
Defontaines and Prost theory may be useful in further 
investigations of the SmA— HexB problem. 

We hope that our work and reinvestigation of the long 
standing SmA— Hex-B transition in smectic liquid crys- 
tal materials will motivate further theoretical, numerical 
and experimental investigations of this very interesting 
problem. 
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